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Determining the Need for Record 
Deduplication 


LESSON OVERVIEW 
In this lesson, you will learn how to determine the need for record deduplication. 


LESSON OBJECTIVES 
After completing this lesson, you will be able to: 


e Determine the need for record deduplication 


Records Match and Consolidation 
Understanding the Purpose of Matching 


The goal of matching is to determine whether records refer to the same entity. This involves 
evaluating how well the individual fields, or attributes, of records match each other. 


Continuous Monitoring 
Measure ongoing data quality scores and 
provides alerts 
Consolidate 
Combines unique data 
elements from matched Measure 


records Into gpa Quantifies the number 
and types of defects 


Data Assessment 


Match 


identifies duplicate 
records within Assesses the 


multiple tables or nature and cause 
databases of data defects 


Analyze 





Match & Consolidate 


Parse 


Appends additional data sida 


— io oar of \ elements in data 
e information l l structures 


Data Enhancement 
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Data Cleansing 


A Figure 23: Data Quality Framework - Match and Consolidate 


